A non-convex optimization framework for large-scale low-rank matrix factorization

نویسندگان

چکیده

Low-rank matrix factorization problems such as non negative (NMF) can be categorized a clustering or dimension reduction technique. The latter denotes techniques designed to find representations of some high dimensional dataset in lower manifold without significant loss information. If representation exists, the features ought contain most relevant dataset. Many linear dimensionality formulated factorization. In this paper, we combine conjugate gradient (CG) method with Barzilai and Borwein (BB) method, propose BB scaling CG for NMF problems. new does not require compute store matrices associated Hessian objective functions. Moreover, adopting suitable step size along proper nonmonotone strategy which comes by convex parameter ηk, results algorithm that significantly improve CPU time, efficiency, number function evaluation. Convergence result is established numerical comparisons methods on both synthetic real-world datasets show proposed efficient comparison existing demonstrate superiority our algorithms.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Non-convex Geometry of Low-rank Matrix Optimization

This work considers the minimization of a general convex function f(X) over the cone of positive semidefinite matrices whose optimal solution X⋆ is of low-rank. Standard first-order convex solvers require performing an eigenvalue decomposition in each iteration, severely limiting their scalability. A natural nonconvex reformulation of the problem factors the variable X into the product of a rec...

متن کامل

A Non-convex One-Pass Framework for Generalized Factorization Machines and Rank-One Matrix Sensing

We develop an efficient alternating framework for learning a generalized version of Factorization Machine (gFM) on steaming data with provable guarantees. When the instances are sampled from d dimensional random Gaussian vectors and the target second order coefficient matrix in gFM is of rank k, our algorithm converges linearly, achieves O(ǫ) recovery error after retrieving O(kd log(1/ǫ)) train...

متن کامل

A Non-convex One-Pass Framework for Generalized Factorization Machine and Rank-One Matrix Sensing

We develop an efficient alternating framework for learning a generalized version of Factorization Machine (gFM) on steaming data with provable guarantees. When the instances are sampled from d dimensional random Gaussian vectors and the target second order coefficient matrix in gFM is of rank k, our algorithm converges linearly, achieves O( ) recovery error after retrieving O(kd log(1/ )) train...

متن کامل

A Nonconvex Optimization Framework for Low Rank Matrix Estimation

We study the estimation of low rank matrices via nonconvex optimization. Compared with convex relaxation, nonconvex optimization exhibits superior empirical performance for large scale instances of low rank matrix estimation. However, the understanding of its theoretical guarantees are limited. In this paper, we define the notion of projected oracle divergence based on which we establish suffic...

متن کامل

Large-Scale Convex Minimization with a Low-Rank Constraint

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation guarantees. Each iteration of the algorithm involves (approximately) finding the left and right singular vectors corresponding to the largest singular value of a cer...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Machine learning with applications

سال: 2022

ISSN: ['2666-8270']

DOI: https://doi.org/10.1016/j.mlwa.2022.100440